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Abstract. We study random walks on contingency tables with fixed marginals, cor- 
responding to a (log-linear) hierarchical model. If the set of allowed moves is not a 
Markov basis, then there exist tables with the same marginals that are not connected. 
We study linear conditions on the values of the marginals that ensure that all tables 
in a given fiber are connected. We show that many graphical models have the posi- 
tive margins property, which says that all fibers with strictly positive marginals are 
connected by the quadratic moves that correspond to conditional independence state- 
ments. The property persists under natural operations such as gluing along cliques, 
but we also construct examples of graphical models not enjoying this property. We 
also provide a negative answer to a question of Engstrom, Kahle, and Sullivant by 
demonstrating that the global Markov ideal of the complete bipartite graph ^3,3 is 
not radical. 

Our analysis of the positive margins property depends on computing the primary 
decomposition of the associated conditional independence ideal. The main technical 
results of the paper are primary decompositions of the conditional independence ideals 
of graphical models of the A-cycle and the complete bipartite graph K2,n-2> with 
various restrictions on the size of the nodes. 



Contents 

1. Introduction 2 

2. Lattice walks, binomial ideals, and positive margins 4 

3. Graphical models and the global Markov statements 6 

4. The positive margins property and graphical models 8 

5. Binary iV-cycle models 14 

6. The complete bipartite graph ^2,^-2 18 
References 25 



Date: June 20, 2012. 

2010 Mathematics Subject Classification. Primary: 13P10, 52B20, Secondary: 11P21, 60J22, 62J12, 
05C81. 

Key words and phrases, algebraic statistics, Markov basis, connectivity of fibers, binomial primary 
decomposition. 

In November 2011 TK and JR worked intensively on this project during a two-week "Research 
in Pairs" stay at Mathematisches Forschungsinstitut Oberwolfach. TK is supported by an EPDI 
fellowship. JR is supported by the Volkswagen Foundation. SS is support by the David and Lucille 
Packard Foundation and the U.S. National Science Foundation (DMS 0954865). 

1 



2 



THOMAS KAHLE, JOHANNES RAUH, AND SETH SULLIVANT 



1. Introduction 

Let B be a finite subset of Z n , and consider the graph with vertex set N n (here, N 
denotes the natural numbers including zero) and edges (u, v) whenever u — v G ±B. 
We want to study the connected components of this graph. Our motivation comes from 
Markov chain random walks on N n using the elements in B as moves. If every edge in 
this graph has positive probability, then the connected components are the irreducible 
components of the Markov chain. 

A necessary condition for u,v G N n to be connected by B is that their difference 
vector u — v lies in the lattice Z£> generated by B. We want to know when this condition 
is sufficient. In this paper we assume that the lattice 7LB is saturated, that is, it can be 
written as the integer kernel ker^ A of an integer matrix A. We do not require B to be 
a basis of Zi3 — there can be more than rank(Zi3) generators. For any u G N n we call 
(ti+Zi3)nN n the fiber of u. For example, in the statistical analysis of contingency tables, 
people are interested in the set of all contingency tables with given marginals. In this 
case, the matrix A corresponds to the linear map that computes the marginals from 
a contingency table. Monte Carlo sampling techniques are then applied to compute 
approximate p-values in Fisher's exact test for conditional inference [11, 12]. 

In the literature, often the following inverse problem is studied: Given a saturated 
lattice and a point u G N n , find a set B such that the fiber of u is connected. Such a 
set is called a Markov subbasis in [7]. Ideally one wants to compute a Markov basis, a 
finite set that connects all fibers at once. 

The fundamental theorem of Markov bases (see [12, Theorem 1.3.6] and Theorem 2.2 
below) implies that Markov bases can be found using computer algebra. Despite 
fast computers, excellent algorithms [23], and efficient implementations [1], comput- 
ing Markov bases remains hard and is out of reach for many practical applications. 
Furthermore, since Markov bases are guaranteed to connect every fiber, they might be 
much larger than needed to connect a particular fixed given fiber. In this paper we 
study conditions on the fiber that certify that a given set of moves connects this fiber. 
In particular, we say that B C ker^ A has the positive margins property with respect 
to the matrix A if (Au)% > for all i implies that the fiber of u is connected by B. This 
property depends not only on the lattice ker^ A but also the particular matrix A. 

The main focus in this paper is on lattices and moves associated to graphical models. 
For graphical models there is a canonical set of "simple" moves, which correspond to 
the global Markov conditional independence statements. It has been observed that for 
some models, if a contingency table u has strictly positive margins, then these simple 
moves connect the fiber of u [6]. Similarly, for the no-three- way interaction model 
Bunea and Besag proved a positive margins property for a set of "simple" moves [5]. 
In the present paper, we perform a systematic study of the positive margins property 
for graphical models. 
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Connectivity of lattice walks can be studied with tools from commutative algebra 
using the following idea: Consider the binomial ideal 

Ib = (p u+ -p u - :ueB)ck\ Pl7 ..., Pn ] 1 

where k is a field, u = u + — u~ is the minimal support decomposition of u into positive 
and negative parts, and p v = p"i ■ ■ -p v ™ . The following result is well-known (see [10] 
and references therein): 

Proposition 1.1. Two points u, v G N n are connected by a path u = u , u%, . . . ,u n = v 

in N n with Ui+i — Ui G ±B if and only if p u — p v G ig. 

Diaconis, Eisenbud, and Sturmfels [10] proposed to analyze the connectivity of the 
fibers of B using a primary decomposition of the ideal Ib- In Section 2 we study the pos- 
itive margins property and relate it to decompositions of Ib- In particular, Lemma 2.5 
gives a sufficient condition and a necessary condition for the positive margins property 
to hold. We also study a generalization of the positive margins property, which we call 
interior point property. 

Our ideals Ib are conditional independence ideals, in addition to being motivated 
by the application to random walks. Primary decompositions of conditional indepen- 
dence ideals are interesting in their own right, since they reveal important information 
about the set of probability distributions that satisfy the conditional independence 
statements [12, 17, 24, 31]. Moreover, it is interesting to know whether Ib is radical. 
Section 3 provides background on graphical models and conditional independence. 

Section 4 studies the positive margins property of graphical models and radicality 
of their global Markov ideals. Both properties are preserved when forming the coned 
graph and when gluing graphs along cliques. In particular, decomposable graphs have 
both properties. From our results we deduce that, if all nodes are binary, then all 
global Markov ideals of graphs on five or fewer nodes are radical, and the complete 
bipartite graph K 2) 3 is the only graph on five or fewer nodes which does not satisfy the 
original positive margins property while it does satisfy the interior point property. We 
also find graphical models without positive margins property, for any choice of matrix 
A, when the contingency table is sufficiently large (Theorem 4.12). 

The graphical models of the iV-cycle and the complete bipartite graph fT2,iv-2 (with 
restrictions on the sizes of the contingency tables) are discussed in detail in Sections 5 
and 6. We construct Markov bases and show that the global Markov ideals are radical 
by computing the primary decompositions. 

Our results suggest a number of different directions for further research. First, in 
our analysis we profited from the fact that all conditional independence ideals that we 
studied are radical. There do exist non-radical global Markov ideals, but we do not 
know how abundant those are. Second, our proofs of the positive margins property 
and interior point property for B depend on knowledge of a Markov basis for the 
lattice TLB. It remains an open problem to develop proofs that do not depend on that 
extra knowledge. 
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2. Lattice walks, binomial ideals, and positive margins 

As Diaconis, Eisenbud, and Sturmfels [10] observed, the connectivity of the lattice 
walk induced by the moves in B can be analyzed by looking at a decomposition of the 
ideal Jg. Indeed, suppose that l B = f\Ii. Then p u — p v G Ib if and only if p u — p v G Li 
for all i. The following example demonstrates how to profit from this simple idea. 

Example 2.1 (cf. [10, Example 1.2]). Which lattice points in N 2 can be connected by 
the moves B = {(2, —2), (3, —3)}? The solution can be read off from the decomposition 

h = (pI ~ p\,p\ - Pi) = (Pi - P2) n (pI,pI). 

Now, p a — p b G (pi — P2) if and only if a\ + a<i = bi + 6 2 , while p a — p b G (Pi,pl) if and 
only if max{ai,a2} > 2 and max{&i,&2} > 2. Hence, a and b are connected by B if 
and only if a\ + 0,2 = &i + &2 and min{max{ai, 02}, max{6i, 62}} > 2. □ 

The first decomposition that comes to mind is primary decomposition. If the ground 
field is algebraically closed, then, since Ib is binomial, there is a binomial primary 
decomposition Ib = fljPj, where Pi are generated by binomials. When the primary 
decomposition introduces new coefficients, then it is too fine to accurately reflect the 
combinatorics of B — everything that matters in Proposition 1.1 are pure differences 
(i.e. binomials of the form p u — p v ). In this case one should work with a mesoprimary 
decomposition of Is [20], the finest decomposition into unital binomial ideals (i.e. ideals 
generated by pure differences and monomials). In the examples studied in this paper 
all ideals are radical, and the primary and mesoprimary decompositions agree. 

The "most important" associated prime of Jg, according to [29, p. 116], is the toric 
ideal I%b = : (riig[n]P*) > which is the only associated prime of that does not 
contain variables. It equals the kernel of the ring homomorphism 

(2.1) cj)* A : : % = 1, . . . , n] -> kfa, 9j l : j = 1, . . . , h], Pt ^H 0- 

j 

where A is an integral matrix such that ker^ A = ZB. Equivalently, Izb = (p u — p" '■ 
11,1)6 N n , Au = Av) [28]. From this follows: 

Theorem 2.2 (Fundamental Theorem of Markov bases [12, Theorem 1.3.6]). A set 

B C ker^ A is a Markov basis if and only if I® = Izb- 

The following is our basic definition. 

Definition 2.3. Assume that B generates a saturated lattice Z£>, and let A be a 
non-negative integer matrix such that Z*B C ker^ A. Then B has the positive margins 
property (with respect to A) if (Au)i > for all i implies that the fiber of u is connected. 

In most of the examples below, TLB = ker^ A. Still, the choice of the matrix A is 
crucial. In many situations there is a canonical choice, such as the marginal computing 
matrix in the case of graphical models (see Section 3). We can augment any matrix by 
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adding rows which do not effect ker^ A, but yield further nontrivial positivity conditions 
to check. A natural choice is to add all linear functionals corresponding to facets of 
the cone M>o^4 generated by the columns of A. In this case, the condition (Au)i > 
for all i says that Au lies in the relative interior of the cone IR>oA 

Definition 2.4. Let B be a set of generators of the integer kernel ker^ A of the integer 
matrix A. Then B has the interior point property if it connects every fiber for which 
Au lies in the relative interior of the cone R>oA 

We now prove an algebraic criterion to decide the positive margins property. For 
any ideal / C k[p], let mj := Y\{pi ^ -0 be the product of the variables not contained 
in I, and let ui be the exponent vector of mj. We also need the product rhj := YliPi '■ 
(I : Pi) = 1} of all variables that are regular modulo I and its exponent vector iij. If / 
is a prime or a radical cellular ideal, then mj = rhj. 

Lemma 2.5. Let B span a saturated sublattice of keiz A for some non-negative integer 
matrix A. Let I& = (nf =1 li) H Izb be a decomposition such that Izb 2 h for all i. 

• If for all i = 1, . . . , c there exists j such that (Au/Jj = 0, then B has the positive 
margins property with respect to A. 

• If B has the positive margins property with respect to A, then for all i = 1, . . . , c 
there exists j such that (Auj.)j = 0. 

Proof. For the first statement, suppose that u, v G N" lie in the same fiber, but are not 
connected. Then p u — p v G Izb \ Ib, and hence p u — p v (jz h for some i. In particular, 
either p u ^ Ii or p v ^ Jj. Assume that we are in the first case. Then p u is a divisor 
of m% for some integer a. Now, if there exists j such that (Auijj = 0, then also 
(Au)j = 0, since A is non-negative. This shows the first statement. 

For the second statement, suppose that (Au,j.)j > for some i and all j. Let p u —p v be 
a binomial in Izb\I%- Then (A(u-\-Ui.)) = (A(v -\-ujJ) > 0, but since rhi.(p u —p v ) ^ h, 
the two vectors u + Ui and v + Ui are not connected by B. □ 

Note the asymmetry between the two directions, the first using ui v the second Ui v 
If all Ii are prime, then = m^. In this case Lemma 2.5 gives an equivalent 
characterization of the positive margins property. 

If the positive margins property is not satisfied, then one might still hope that the 
fibers are connected if the marginals are large enough. This is the case in Example 2.1. 
Unfortunately, if is radical, then this is not true: 

Lemma 2.6. Assume that B does not have the positive margins property with respect 
to A, and suppose that I® is radical. For any b > there exist u, v G N n such that 
(Au)j = {Av)j > b for all j, but p u — p v G' Ib- 

Proof. Let Ib = IzB^i^iPi) be the decomposition into minimal primes. By assumption 
and Lemma 2.5, for some i the vector up i satisfies (Aupjj > for all j. For any 
binomial p u —p v G Izb\Pi there exists a c large enough such that the exponents satisfy 
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(A(u + cupi))j = (A(v + cupi))j > b for all j. Since P, is prime, mp i is regular and 
therefore m c Pi (p u — p v ) ^ Pj. Hence u + cui and v + cui are not connected. □ 

Example 2.1 shows that the radicality assumption in Lemma 2.6 is necessary. 

3. Graphical models and the global Markov statements 

Let V = [N] := {1, . . . ,N} for some integer N > 1. For each v E V let X„ be 
a discrete random variable taking values in [d v ], d v > 2. Let d = (d v ) ve v and let 
X = Yl veV [d v ]. For any W C V the random vector X w = (X w )^ eM / takes values in 
<^V — n^eVK^]- H x E X and W E V, let x^y := (aJ^ew- With h = \X\, denote 
~R h := <S> veV ^L dv the space of real d Vl x • • • x d„ r arrays of the form p = (p x )xex- Then 
W h contains the probability simplex 

A A _i := lpER h : ^p x = l,p* > for all x E X I . 

I x£X J 

Eachp E A/ t _! represents a joint probability distribution of (X v ) v€V . The dependencies 
among Xi, . . . ,Xn are often visualized by an undirected graph G = (V,E). In this 
paper, all graphs are undirected and simple. There are two ways that such a graph can 
be interpreted as a statistical model, 1.6. £lS du family of joint probability distributions. 
The first leads to the global Markov model, the second to the graphical model. 

The global Markov model associates to G a family of conditional independence state- 
ments among the random variables. Let V A = y4UPUCbea partition of V (into 
disjoint possibly empty sets), and let p E A fo _x. We write Xa JL X b \X c and say that 
Xa is independent of X B given X c if and only if 

J. J 4^ ^ ^-*- j4_ _B £7 ^ ^ C/ ABC 

for all possible values x A , x' A , x B , x' B , x c of X A , X B , Xq, respectively. See [12] for an 
introduction to conditional independence from an algebraic point of view. 

For each x c E Xq we construct a matrix P A ' B ' x c Q f format \Xa\ x \X b \, with columns 
indexed by Xa and rows indexed by X B . The entry in the xa,x b position of P A ' B ' x c 
is the probability p XAXBXC . The conditional independence statement Xa JL X B \X C is 
equivalent to the condition that for all xq E Xq, rank(P A ' B ' Xc ) < 1. If C = we get 
one matrix, and in general we get \Xc\ matrices. 

Let 

I x A ±x B \x c be the ideal in M[p x : x E X] generated by the 2x2 minors of all 
the matrices P A > B > x c . If C is a collection of conditional independence statements, we 
let 

Ic= ^2 Ixa±Xb\x c - 
(x A ±x B \x c )ec 

To the graph G we associate the global Markov statements 

gl(G) = {X A X X B \X C :C separates A and B in G, A U B U C = V}. 
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Separation means that every path in G from some vertex a G A to some vertex b G 
i? traverses some vertex c G C. The global Markov model of G is the intersection 
of Ah-i and the variety of I g i(G)', i.e. it consists of all joint probability distributions 
satisfying gl(G). Note that, while most statements in this paper are independent 
of the choice of the field k, only the variety over the real numbers has a natural 
statistical interpretation. In general, conditional independence statements are defined 
for arbitrary subsets A, B, C C V, and the global Markov statements are defined 
without the requirement A U B U C = V. However, if A, B, C C V are disjoint subsets 
such that A U B U C 7^ V and such that C separates A and B, then the statement 
Xa JL Xb \Xq is implied by the statements in gl(G), see [14, Lemma 7.10]. 

Graphical models are defined parametrically: Let C(G) be the set of cliques of G, 
where a clique is a set of vertices W C V such that if v%, V2 G W, v% =fi V2, then (vi, V2) 
is an edge of G. To each clique C G C(G) and each x G G Xq associate a parameter 6 Xc 
(or an indeterminate, depending on the context). Let 9 C := (0 xc )x c &x c - The image of 
the polynomial map 

ceC(G) ceC(G) 

intersected with the probability simplex A^_i is the parametrized graphical model A4* G - 
In other words, Ai* G consists of all probability distributions p whose components can 
be written as a product of the form p x = Ylwec fw(%), where fw are nonnegative 
functions that only depend on x v for v G W. See [21] for more about graphical models. 
The map 4>g induces the ring homomorphism 

<j>* G :R\p x :xeX]^R[6f :CeC(G),yceXc], Px ^ n C> 

ceC(G) 

and its kernel Iq = ker (f)* G is the vanishing ideal of the image. Then Ai G — V(I G )(]Ah-i 
is the closure of the parametrized graphical model A4 G . We call Ai G the graphical 
model of G. Note that other authors use the term "graphical model" only for the set 
of strictly positive probability distributions in Ai G . 

The ring homomorphism <p* G is of the form (2.1); hence I G is a toric ideal. The corre- 
sponding matrix A G has a natural interpretation: If p is a joint probability distribution 
of (X v ) ve y, then the product A G p contains, as subvectors, the marginal distribution 
induced by p on any clique of G. This collection of marginals are the G-marginals of p. 
The cone generated by the columns of A G is known as the marginal cone. 

It is easy to check that the graphical model is a subset of the global Markov model. 
Moreover, the Hammersley- Clifford Theorem [2] says that if a probability distribution 
is strictly positive (that is p x > for all x in the state space), then p lies in the graphical 
model if and only if p lies in the global Markov model. Algebraically, this theorem says 
that Iq equals the toric component of I S \(G)- 
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In general, I s \(g) $! Ig, in which case, there may be probability distributions which 
satisfy the conditional independence statements gl(G), but are not in the closure of 
the graphical model. In fact, I g \(G) — Ig if and only if G is a chordal graph [15]. As 
suggested in [29, Chapter 8] and [15], the discrepancy between the two models can be 
analyzed using primary decomposition. 

4. The positive margins property and graphical models 

In this section we study which global Markov models have the positive margins 
property. Let G be a graph with vertex set V = [N], and let d = (d v ) v( zy e 
with d v > 2 for all v. We say that (G, d) has the positive margins property, if the 
quadratic moves £> g i(G) have the positive margins property with respect to the canonical 
matrix Aq, and (G, d) has the interior point property if £> g i(G) has the interior point 
property. 

Our main tool is Lemma 2.5 which we translate here to graphical models. As all 
global Markov ideals with known primary decompositions are radical, we only formulate 
the radical case. 

Lemma 4.1. Let I s ug) — (nf =1 Pj) DIg be a decomposition into prime ideals such that 
Ig 52 Pi for all i. Then (G,d) has the positive margins property if and only if for all 
i — 1, . . . , c the G-margins of up i are not strictly positive. 

Table 1 summarizes some of our computational results. We computed Markov bases 
with 4ti2 [1] and binomial primary decompositions using the package Binomials [18] 
in Macaulay2 [16]. Then we used the Macaulay2 package Polyhedra [3] to check the 
condition of Lemma 4.1 applied to the primary decomposition. The binary graphical 



graph 


pos. margins 


interior point 


Igl(G) radical 


# of min. primes 


c 4 


yes 


yes 


yes 


9 


square-pyramid 


yes 


yes 


yes 


81 




yes 


yes 


yes 


201 


^2,3 


no 


yes 


yes 


37 


c 5 


yes 


yes 


yes 


41 



Table 1 . Properties of binary graphical models for selected irreducible graphs. 



model of every graph on five or fewer vertices that is not mentioned in Table 1 satisfies 
the positive margins property, and the corresponding global Markov ideals are radical. 
These results suggest two general questions: 

• Is it true that for any graphical model the ideal I g \(G) is radical [14]? 

• Does every graphical model have the interior point property? 
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The answers to both questions are negative in general. Example 4.9 discusses the 
binary CI ideal of which is not radical. Theorem 4.10 settles the second question. 

Before discussing the graphs of Table 1, we treat reducible graphs. Note that all 
graphs on five or fewer vertices not contained in this table are either complete or 
decomposable, in the following sense: 

Definition 4.2. A graph G = (V, E) is reducible if there exist proper subsets Vi, V 2 C 
V such that Vi n V 2 is a clique, and such that G is the union of the subgraphs G\ and 
G 2 induced on V\ and V 2 . Moreover, G is decomposable if G\ and G 2 are complete or 
decomposable. 

Lemma 4.3. Let k be algebraically closed. Assume that G is reducible into G\ = 
(Vi,Ei) and G 2 = (V 2 ,E 2 ). If both / g i(Gi) an d -^gi(G 2 ) are radical, then I g \(G) is radical. 

Proof. This is [14, Corollary 7.13] together with the observation that the toric fiber 
product of prime ideals is a prime ideal. □ 

Lemma 4.4. If G is reducible into G± = (Vi,Ei) and G 2 = (V 2 ,E 2 ) and if both 
(Gi, (d v ) ve vi) an d (G 2 , (d v ) ve v 2 ) have the positive margins property, then (G,d) also 
has the positive margins property. 

Proof. The proof is essentially the same as that of [30, Theorem 2.9], which shows how 
to obtain a Markov basis of G from Markov bases of G\ and G 2 . The fact that we 
do not have Markov bases here is compensated by the fact that we do not want to 
connect all fibers, but just those fibers with positive margins. In order to apply the 
proof of [30, Theorem 2.9] two things need to be checked: (1) A fiber with positive 
G-margins restricts to fibers with positive G^-margins and G^-margins, respectively. 
(2) When the construction that turns Markov bases of G\ and G 2 into a Markov basis 
of G is applied to <B g i(Gi) an d £>gi(G 2 )> then the result is a subset of £> g i(G)- For brevity 
we omit the details. □ 

By Lemmas 4.3 and Lemma 4.4, decomposable graphs have the positive margins 
property and radical global Markov ideals (for all d). On four or fewer vertices there 
is only one graph, the four-cycle C4, which is neither complete nor decomposable. The 
following theorem is proved in Section 5. 

Theorem 4.5. For N > 4 the binary N- cycle model has the positive margins property. 
Its global Markov ideal I g itc N ) is radical. 

On five vertices there are five irreducible graphs: The complete graph (which trivially 
has the positive margins property), the five-cycle C5 (covered by Theorem 4.5), the 
complete bipartite graph ^2,3, the square pyramid, and the graph G^s (see Fig. 1; 
the name G±$ comes from [26]). The complete bipartite graph K 2j 3 is treated in the 
following theorem, proved in the end of Section 6. 
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Figure 1. G48 and the square pyramid 

Theorem 4.6. For N > 4, the complete bipartite graph K 2 ,n-2, where d v = 2 for 
the first group of 2 nodes, has the interior point property. It has the positive margins 
property if and only if N = 4. Its global Markov ideal is radical for all N > 4. 

We next discuss the pyramid. To obtain a more general result the following definition 
is needed: For any graph G = (V, E) with vertex set V = [N], the cone over G is the 
graph G = (V, E) with V = V U {0} and E = E U {(0, i) : i G [N]}. 

Lemma 4.7. Assume that k is a perfect field. If I s ug) is radical for some d G N v , 
then igi(<3) is radical for all d G N v with d v = d v for all v G V . 

Proof. Let X = [do] x X . For any polynomial / G k.\p x : x G X] denote by /j the 
polynomial in k[p y : y G X] where each variable p x , x G X, has been replaced by p ix . 
Let Ii be the ideal generated by the polynomials /, for all / G igi(G). The equality 

gl(G) = {X A ±X B \X C UI :X A ±X B \X C G gl(G)} 

implies Igrfa — h + • • • + I do- The ideals Ji, . . . , Id are radical, since I g \(G) is radical, 
and Ii, . . . ,I do are generated by polynomials in disjoint sets of variables. To show that 
their sum is also radical it suffices to show that the tensor product of reducible rings 
is again reducible. This is true if the field k is perfect by [4, Chapter 5, §15]. □ 

Lemma 4.8. If (G, d) has the positive margins property, then (G, d) also has the 
positive margins property, where d v = d v for v G [N] and do is arbitrary. 

Proof. Any contingency table u for G can be seen as a family (u^)^^ of contingency 

tables for G. If u has positive G-margins, then each has positive G-margins. Now 
ii and v have the same G margins if and only if ixW and have the same G-margins 
for all i. Hence, if u and v have the same positive G-margins, then and v ^ are 
connected by quadratic moves for all i, and the same moves can be used to connect u 
and i). □ 

It remains to discuss G^. It is easy to see that the binary model for this graph is 
equal to the model of K2.2 with d = (2, 2, 2, 4), and therefore covered by Theorem 4.6— 
G48 has the positive margins property, and its global Markov ideal is radical. 

Next, we give an example of a global Markov ideal that is not radical. 
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Example 4.9. Consider the graph -^3,3, and let d v = 2 for all vertices v G ^3,3- 
The global Markov ideal ^1(^33) is contained in a polynomial ring with 64 indetermi- 
nates. It is generated by 144 = 6-24 quadrics corresponding to the six CI statements 
Xi X Xjk IX456 and Xi X Xjk \X123 , where {i} U {jk} runs through the non-trivial 
bipartitions of {1,2,3} and {4,5,6}, respectively. 

The global Markov ideal I g \(K 3 3 ) is complicated enough that Buchberger's algorithm 
for Grobner basis computation does not terminate within reasonable time. On the other 
hand, a Grobner basis of the graphical model Ik 3 3 can be computed using 4ti2 [1] . This 
is another instance of the fact that toric ideals are less complex than arbitrary binomial 
ideals [27]. 

In view of these complications, the classical tools of computer algebra do not work for 
this example, as they depend on Grobner bases. However, we can use Proposition 1.1: 
containment of a binomial in a pure difference ideal can be checked by analyzing the 
connected components of a graph. We implemented this idea in a C++-library that can 
test whether two exponent vectors lie in the same connected component by enumerat- 
ing their connected components via breadth-first search. The C++-source code of our 
library is available on the Internet under the GPL licence [19]. The directory examples 
contains code for K 33 and other graphs which allows to generate the connected com- 
ponents and construct a path in the case of connectivity. 

To disprove radicality it suffices to find a binomial p u — p" G Ik 3 3 \ Igi(K 33 ) (f° r 
example, a degree four Markov move) and a square- free monomial p w such that p w (p u — 
p v ) /gi(jf 33 ) while p 2w {p u — p v ) G /gi(jf 33 ). Checking the degree four Markov moves 
p u — p v and monomials of degree two, our program found the following witness: Let 

p U — p V := £>121|222P212|212Pl22|112£>222|122 — £>221|222£>112|212£>222| 112Pl22|122 ; 

and let p w := Piii|mP22i|iii (the vertical bar | separates the states of the two groups of 
nodes in K 3 3 ). Then p u p w and p v p w are not connected by gl(K 3 3 ), but p u p 2w and p v p 2w 
are connected. The connected components of p u+w and p v+w consist of 18 monomials 
each, while that of p u p 2w and p v p 2w consists of 90 monomials. □ 

We now construct examples of graphical models that do not have the interior points 
property (and, hence, cannot have any positive margins property). Remember that a 
graph G is triangle-free if it does not contain a cycle of length three, and a graph is 
two- connected if it remains connected when a single node is eliminated. 

Theorem 4.10. Let G be a two- connected triangle-free graph with N vertices, and let 
p > N — 1 be a prime power. If d a = p for all a G [N], then (G, d) does not have the 
interior point property. 

Before proving the theorem, we first give an explicit example. 

Example 4.11. Consider the four-cycle C4 with d = (3, 3, 3, 3), and let 

U — Clin + ei222 + 61333 + C2123 + ^2231 + ^2312 + 63132 + 63213 + 63321- 
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The marginal vector Ac 4 u of u lies in the interior of the marginal cone, and many 
other vectors with the same marginals can be constructed by applying elements of 
the symmetry group (Z/3Z,) 4 . At the same time no quadratic move can be applied 
to u. □ 

The combinatorially inclined reader may have observed two orthogonal Latin squares 
of order three in the last two indices of the elements contributing to u. Recall that a 
Latin square of order d is a (d x d)-matrix L with entries in [d] such that each number 
in [d] appears exactly once in each row and in each column. Two Latin squares L, V 
are orthogonal if •) = (L^i, L' k t ) implies i = k and j = I. For general d the 

number of mutually orthogonal Latin squares of order d is not known. The following 
is known: 

1. There are at least 2 orthogonal Latin squares of order d, unless d £ {1,2, 6}. 

2. There are at most (d — 1) orthogonal Latin squares of order d. 

3. If d is a power of a prime, then there are precisely (d — 1) orthogonal Latin 
squares of order d. 

See [8] for an introduction Latin squares. Theorem 4.10 is a corollary to these facts 
and the following theorem. 

Theorem 4.12. Let G be a two-connected triangle-free graph with N vertices. If there 
exist N — 2 mutually orthogonal Latin squares of order do > 2, then (G, (do, do, ... , do)) 
does not satisfy the interior point property. 

Proof. Let L^ l \ . . . , L^ N ~ 2 ^ be mutually orthogonal Latin squares of order do, and let 

£ = {{i,3, Lf], L^~ 2) ) :i,je [d ]} CX = [d ] N . 
The set £ has the property that for every pair a, b £ [N], a ^ b, one has 

{(l a ,l b ) :/££} = [do] 2 . 
Since G is triangle- free, all G-margins are 2-way margins. The vector u{£) defined via 



u(C)(l) 



1, if I £ C, 
0, otherwise, 



has the following property: All entries in all its 2-way margins are ones. The group 
®A) (A^-th direct power of the symmetric group &d of [do]) acts on X by permuting 
each factor. This action induces an action on the marginal cone that is transitive on 
the extreme rays. Under this action the margins of u(£) are invariant, which implies 
that Agu(£) lies in the interior of this cone and, in particular, is not on any facet. 

On the other hand, it is not possible to apply any quadratic global Markov move to 
the table u(C). Indeed, since G is two connected, any quadratic move v corresponds 
to a statement Xa JL Xb \Xc , where the separator C contains at least two distinct 
elements i,j. Hence, v can only be applied to tables where some entry in the {i,j)~ 
marginal is two. Therefore, u(£) is isolated in its fiber. On the other hand, the 
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symmetric group action on tables sends u(£) to other points in its fiber, so that the 
fiber is disconnected. □ 

Example 4.13 (A binary grapical model without interior point property). We can use 
Theorem 4.12 to show that not all graphs with binary nodes have the interior point 
property. First, C4 with d = (4,4,4,4) does not have the interior point property, since 
there exists a pair of orthogonal Latin squares of order four. We define a graph G 
by splitting every vertex of C4 into an edge as in Figure 2. It can be seen that the 



Figure 2. Splitting all vertices of C 4 . 

binary model of G is equivalent to that of C4 with d = (4, 4, 4, 4) in the sense that 
the ideals Ic A and Ig\(c 4 ) are related to the ideals Iq and I g \(G) via a renaming of the 
coordinates. □ 

All examples where we could prove the interior point property involve graphs where 
the toric ideal Iq is generated in degree at most four, and our proofs of the primary 
decomposition also depend on this fact. 

Question 4.14. If Iq is generated in degree at most four, does this imply that (G,d) 
has the interior point property? 

There are five graphs G on I G such that Iq (with d v = 2 for all v) is not generated 
in degree four; and in this case Iq is generated in degree six [25]. Among these graphs, 
-K3 3 and G154 are the only triangle-free graphs. It is a challenging problem to compute 
primary decompositions of I g i(c) for these two graphs. By Example 4.9 I g i(K 3 3 ) is not 
radical. The same method did not allow us to disprove radicality of I g \(G 1M )- Note that 
G154 can be obtained from K 3 3 by deleting an edge. 




Figure 3. K 3 3 and Gi 54 

Theorem 4.10 proves that for any two-connected triangle- free graph, if the cardinal- 
ities d = (d v ) ve v are increased to all coincide with the same prime power, then this 
model does not have the interior point property. We conjecture that this generalizes 
to many other graphs; i.e. the situation should not improve when the numbers d v are 
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increased. A similar phenomenon occurs with Markov bases. For instance, in the no- 
three-way interaction model, the Markov basis becomes arbitrarily complicated as two 
of the d v diverge [22]. 

Conjecture 4.15. Assume that (G,d) does not have the positive margins (or interior 
point) property. If d' v > d v for allv £ V , then (G, d') does not have the positive margins 
(or interior point) property either. 

5. Binary A^-cycle models 

In this section we study the binary model of the iV-cycle Cn- We find a Markov 
basis (Theorem 5.1) and compute a prime decomposition, showing that I e i(c N ) is radical 
(Theorem 5.6). We then use this decomposition to prove the positive margins property 
(Theorem 4.5). 

We first describe a Markov basis of the toric ideal Ic N - A Markov basis for this 
model was already presented in [9]. Here, we construct a smaller Markov basis, in 
order to simplify our proofs of the primary decomposition. We use tableau notation to 
denote monomials and binomials in the polynomial ring k[p x : x £ X\. The monomial 
Pxi.jxi.a.-.xi jv ' ' ' Px t ,txt,2-x t N i s represented by the following tableau with t rows: 

%1,2 ■ ■ ■ Xl,N~ 
_X t ,t X t ,2 ■ ■ ■ Xt,N_ 

This notation greatly facilitates computations since applying moves to a monomial 
merely corresponds to manipulating the entries of tableau according to rules encoded 
by the moves. Tableau calculations are widely used in algebraic statistics, see for 
example [12]. 

All tableaux in this section are to be considered up to cyclic symmetry, that is, a 
tableau represents also all other tableaux which arise from making the i-ih column the 
(i + k)-th column, where k is arbitrary and indices are considered modulo N. 

Denote £>2 the set of quadrics of the form 

a, b £ [2], A, A' £ [2]', B, B' £ [2] N ~ 1 - 2 , 
A^A',B^B', 0</<iV-2. 

By convention, this means that the a- and 6-columns are at arbitrary non- adjacent 
positions in the binomial. The quadrics in B2 therefore correspond to conditional 
independence statements of the form {Xk+i, • • • , A;_i} X {-Xj+i, • • • , Xk-i\ \ {Xk, X{\ 
with k and I non-adjacent. Note that gl(Cjv) contains further statements; but their 
quadrics are contained in the ideal generated by those in £> 2 - 



(5.1) 



a A b B 
a A' b B' 



a A' b B 
a A b B' 
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To each binary state K G X there is a unique opposite state K e X, defined by 
switching 1 and 2 in each component. Let B^ be the set of quartics of the form 



(5.2) 



'A 


B 


C 




'A 


B 


C 


A 


B 


C 




A 


B 


C 


A 


B 


C 




A 


B 


C 


A 


B 


c 




A 


B 


C 



A e [2]\Be [2] l - k ,C e [2] N - 1 , 

< k < I < N. 



Theorem 5.1. For N > A, the set Bi U £>4 is a Markov basis of the binary graphical 
model of the N -cycle. 



Remark 5.2. For N = 3 the cycle is a complete graph, and therefore Iq = L 



gl(G) 



0. 



The single generator contained in B\ defines another interesting statistical model: the 
no-three- way interaction model. It is the hierarchical model of the graph C3, considered 
as a one-dimensional simplicial complex (see [12]). Such models were named graph 
models in [9], in order to distinguish them from graphical models. For N > 4, all 
cliques of the iV-cycle are edges, and therefore the graphical model agrees with the 
graph model. 

Proof of Theorem 5.1. We prove that £>2 U B4 is actually a Markov basis of the graph 
model of Cat for all N > 1. We use induction on N. For N < 3 both B2 and B4 are 
empty, and the graph model contains all probability distributions. For N = 3 the set 
£>2 is empty, while B4, contains only the defining quartic of the binary graph model 
of GV 

The iV-cycle is a codimension-one toric fiber product of a chain of length (N — 1) 
with a chain of length three (see [14]). Since these chains are decomposable graphs, the 
Markov bases of these chains consist of quadratic moves, corresponding to conditional 
independence statements. These Markov bases are slow- varying, in the sense of [14], 
and gluing them yields moves in i?2- By [14, Theorem 5.10], in order to obtain a 
Markov basis of the iV-cycle, we need to add further quadrics (which belong to B2) 
and a Markov basis of the corresponding co dimension-zero toric fiber product, which 
is the toric fiber product of an (N — l)-cycle with the graph model of the 3-cycle. By 
induction, we know the Markov bases of these smaller cycles, and by [14, Theorem 5.4] 
we need to lift these Markov bases (and add some further quadrics that belong to £> 2 ). 
A lift of a quadric gives again a quadric from B 2 , and hence it suffices to consider the 
quartics. 

We first show that the ideal /e 2 us 4 contains all tableaux of the form 



(5.3) 



where each entry is a {l,2}-string of length at least one. Suppose that there is a 
column k such that A k = GV Without loss of generality, assume A k = C k = 1. 



1 


1 


1 


A 




1 


2 


1 


A 


1 


2 


2 


B 




1 


1 


2 


B 


2 


1 


2 


C 




2 


2 


2 


C 


2 


2 


1 


D 




2 


1 


1 


D 
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Decompose the strings A,B,C,D into substrings, such that A 
The tableau calculation 



(AiAkA r ), and so on. 



1 1 1 Ai 1 A r 

1 2 2 Bi b B r 

2 1 2 Ci 1 C r 
2 2 1 Di d D r 



1 1 2 Q 1 A r 

1 2 2 Bi b B r 

2 1 1 A, 1 C r 
2 2 1 Di d D r 



* 
* 
+ 
+ 



2 
1 
2 
1 



2 
2 
1 
1 



Q 
B, 
A t 
D, 



1 

b 
1 

d 



D r 



2 
1 
2 
1 



1 
2 
2 
1 



At 
B, 
Q 
D, 



1 A r 

b B r 

1 C r 

d D r 



shows that this move actually lies in the ideal generated by the quadrics. Here, * and 
+ mark the rows to which a quadric has been applied. By symmetry, the same holds 
true if B k = D k for some k. If, in the tableau (5.3), A k ^ C k and B k ^ D k for all k, 
then C = A and D = B, and the move is of the form 



1 

2 
1 
2 



1 

2 
2 
1 



.4' 
~A 

B 



2 
1 
2 
1 



1 
2 
2 
1 



.4 
B 
A_ 
B 



Hence, invoking the symmetry and exchanging 1 -<->■ 2 in some columns of the last block, 
we may assume that any column in the last block agrees with a column from either 



the first or the third block. If 



then the lift belongs to B±. Otherwise, 



using a rotation of the cycle the move can be brought into the form 



1 
2 
1 
2 



1 

2 
2 
1 



.4 
B 
A 
B 



2 
1 
2 
1 



1 

2 
2 
1 



.4 
B 
A 
B 



Applying quadrics to the first two rows transforms this into the move 



1 

2 
1 

2 



1 

2 
2 
1 



5 

.4 
A. 
B 



2 
1 
2 
1 



1 

2 
2 
1 



B 
A 
A_ 

B 



In this move, the first and third entries of the last column agree, and by the argu- 
ment given above, it is a combination of quadrics. Now the theorem follows from the 
observation that, up to symmetry, any lifted quartic is of the form (5.3). □ 

For any quartic / of the form (5.2) let 

Pf = (pi : Pi divides neither / + nor f~). 
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Lemma 5.3. The ideals Pf are prime ideals containing I g \(c N )- 

Proof. Clearly, Pf is a monomial prime ideal. Each generator of I g i(c N ) is of the 
form (5.1). If the left term \_ a a ^i I is not contained in Pf, then it divides f + f~- 
In this case either A = A' or B = B' , and so both terms in (5.1) agree. Hence, Pf 
contains all generators of I g \(c N )- D 

Proposition 5.4. The minimal primes of I g \(c N ) are precisely the toric ideal Ic N and 
the monomial ideals Pf. 

The proof of Proposition 5.4 makes use of the following lemma. 

Lemma 5.5. Let f = f + — f~ 6 B 4 be a quartic generator of Ic N - If the variable pi 
divides neither f + nor f~, then pif e I g \(c N )- 

Proof. We have to show that p^f is a combination of quadrics coming from conditional 
independence statements of the iV-cycle. Up to symmetry, pif is of the form 



"l 


1 


1 " 




2 


1 


l" 


1 


2 


2 




1 


2 


1 


2 


1 


2 




1 


1 


2 


2 


2 


1 




2 


2 


2 


K 


L 


M 




K 


L 


M 



where Pi = Pklm- We now transform pif into another binomial pjf of total degree 
five using quadrics. Then pjf belongs to the toric ideal Ic N , and hence / G Ic N ■ Since 
Pj 7^ Pi the multidegree of / is not the multidegree of any quartic in £> 4 . Therefore, / 
must be a combination of quadrics, and we are done. 

Using the symmetry we may assume that K, L, M all contain at least one 1, i.e. KLM = 
K1IK2L1IL2M1IM2. The tableau calculation 



2 


1 


1 




2 2 2 


111 


1 




2 2 2 


111 


1 1 1 


1 


2 


1 




1 1 1 


2 2 2 


1 


* 


K x \ 1 


2 2 2 


1 1M 2 


1 


1 


2 


* — > 


1 1K 2 


L x \ 1 


2 




1 \K 2 


Lil 1 


2 2 2 


2 


2 


2 




2 2 2 


2 2 2 


2 




2 2 2 


2 2 2 


2 2 2 


K 


L 


M 


* 


K x l 1 


1 1L 2 


M 


* 


111 


1 1L 2 


Mil 1 



2 2 2 


1 IL 2 


Mil 1 


K x \ 1 


2 2 2 


1 1M 2 


1 1K 2 


L x l 1 


2 2 2 


2 2 2 


2 2 2 


2 2 2 


1 1 1 


111 


111 



shows how to transform the second term of pif such that the resulting binomial is of 
the form p m /. □ 
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Proof of Proposition 5.4- Let p G V(I g \(c N )) \ V(Ic N )- Then there is a quartic / G B4 
such that f(p) 7^ 0. Lemma 5.5 implies that px = for all K such that px does 
not divide f + f~, and hence p G V(Pf). Clearly, the ideals Pf are all distinct. By 
symmetry, they are all minimal primes. □ 

Theorem 5.6. The global Markov ideal I g i(c N ) is radical and has prime decomposition 

^kcn) = ic N n p| Pf. 

Proof. The intersection J := Iq n PI fl/eB 4 Pf * s a binomial ideal, because, by Proposi- 
tion 5.4, it is the radical of the binomial ideal I g \(c N ) [13, Theorem 3.1]. Therefore, it 
suffices to consider an arbitrary binomial p u — p v G J and show that it is contained 
in I g uo N ). Since J is homogeneous in the multigrading of the toric ideal Ic N , there 
exists a sequence v = u ,Ui, . . . ,u r = u such that Ui — is a move in the Markov 
basis B 2 U B4 of Ic N - If only quadratic moves are necessary, then p u — p" G J. Assume 
that Ui — Ui-i is the first quartic move, and let / be the corresponding quartic binomial. 
Then p v — p^- 1 g Igi(c N ) C P/, and hence p"*- 1 — g P/. Therefore, p" 4 - 1 must be 
divisible by a variable generating P^; and by definition, p Ui is divisible by the same 
variable. Hence, p Ui — p^- 1 g I g i(c N ) by Lemma 5.5. Iteration of this argument shows 

p u -p v el gl(CN) . ' ' □ 

Remark 5.7. The minimal primes of I g i(c N ) are exactly witnessed by degree four 
binomials in the Markov basis of Ic N - More precisely, if / G B4 then (Ic N : /) is a 
minimal prime, and all minimal primes arise in this way. 

Proof of Theorem 4-5. Let P = Pf be one of the minimal primes, where / is a quartic 
of the form (5.2). Then mp = f + f~. Since iV > 4, the quartic / has at least 
two neighbouring columns i, i + 1 which are identical (up to symmetry). Hence not all 
components of the {i, i + l}-marginal of the exponent vector of mp can be positive. □ 



6. The complete bipartite graph K 2 . 



N-2 



In this section we study the complete bipartite graph with vertex sets {1, 2}, 

{3, . . . , iV} and with d% = d 2 = 2 and arbitrary d 3 , . . . , d^. A Markov basis of the 
graphical model is presented in Theorem 6.1. Using this Markov basis we compute 
a prime decomposition and show that igi(K 2JV _ 2 ) is radical (Theorem 6.5). With this 
decomposition we prove that for iV > 4 the complete bipartite graph does not satisfy 
the positive margins property (Theorem 6.6), but the interior point property (Theo- 
rem 6.8). 

The set gl(i^2,7v-2) consists of the CI statement X\ JL X 2 \{X^, . . . , X^} and all 
statements Xa JL Xp \{X\, X 2 , Xc} , where A, B, C is a partition of {3, . . . , N}. The 
variables of the polynomial ring k[p x : x G X\ can be arranged in a (2 x 2 x <i 3 x ■ ■ • x ex- 
tensor p = (pijK '■ i G [2],j G [2], K G nfLst^s] )• Define (d 3 x • • • x G?7v)-tensors and 
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(2 x 2)-matrices B K via A\ = B^ := PijK- Then A l i and B K are slices of p. The two 
sets of CI statements in gl(fT 2 ,A r -2) correspond to the two ideals 

Ix — (2 x 2 minors of flattenings of A tJ , j G {1, 2}) and 

I 2 = (2 x 2 minors of B K ,K e U^M)- 

In Ji we take all flattenings of the (iV— 2)-way tensor A 1 ^ down to a matrix and compute 



the 2x2 minors of those matrices. With this notation we have /, 
The quadratic generators of I2 are of the form 

(6.1a) 



gl(K 2 ,N-2) 



h + h- 



"1 


1 


K 




"1 


2 


K 


2 


2 


K 




2 


1 


K 



and up to symmetry the generators of I\ are of the form 



(6.1b) 



K 
K' 



L 
V 



K' 
K 



L 
V 



where i, j, K, K' , L, L' are arbitrary in their respective domains (here, the symmetry 
says that we can permute the last iV — 2 columns) . 



Theorem 6.1. A Markov basis of the toric ideal Ik 2N -2 w ^h d\ = 62 
the quadratic generators (6.1) of I g i(K 2 N-2) an< ^ ^ e q uar bic binomials 



2 consists of 



1DL11L12L21L22 ._ 

3;fci,fc2 



At 



L21 
L22 



k 2 
ki 
h 
A-2 



L\2 

L21 
L22 



for all k 1 ,k 2 E [d 3 ] and L u , L12, L 21 , L 22 
quartics B^^f 2lL22 for a = 4, . 
exchanged in the above equation. 



G [di\ x ■•• x [d n ], and the corresponding 
N, where the roles of the columns 3 and a are 



Proof. The proof is by induction on N. The base case N = 4 is [14, Cor. 2.2]. Suppose 
that Theorem 6.1 holds for some N. We show that it also holds for N + 1. The graph 
K 2 ,n-i is obtained by gluing the graph K 2) n-2 and the graph i^ 2 ,i at the first two 
vertices. This is a codimension-one toric fiber product, which is slow- varying, since all 
quartic generators B^^ 2L2lL22 project to the zero polynomial when just considering 
their indices associated to the first two vertices, see [14, §5.3]. 

We first show that the set B which consists of all quartics of the form B^^ 2L2lL22 
and the quadratic moves of the form (6.1b) is a Markov basis of the associated codimension- 
zero toric fiber product, which is the graph model of the graph K 2i n-i with vertex set 
[N + 1] and edge set i < j < N + 1, i < 2}. Again, this can be proved by induc- 

tion: The induction base K 2 ^ = C 3 is discussed in Remark 5.2. By [14, Theorem 5.4], 

i consists of the quadrics generating I 2 and lifts of elements of 



a Markov basis of If> 



the Markov bases of / 



K 



2, N-2 



and Ik . The lift of a quadratic generator of 1^ 



is 
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a quadratic generator of I 2 . The lift of a quartic generator of 1% or i is of the 
form B^}^^ L2lL22 . This proves that B is a Markov basis of jv _ i . 

By [14, Theorem 5.10], we can obtain a Markov basis of Ir 2 n~i fr° m B by adding 
additional quadrics of the form (6.1b) and moves obtained by gluing elements from the 
Markov bases of Ir 2 ,i an d Ik 2N _ 2 - Since K 2t i is decomposable, the quadratic moves 
of the form (6.1a) alone form a Markov basis of I 2> i ( no quartics are needed). These 
quadratic moves can only be glued with the corresponding quadratic generators from 
Ik 2 n-\i an d this gluing procedure yields all quadratic moves of the form (6.1a). 

To sum up, the quartic moves and the quadratic moves of the form (6.1b) belong 
to the associated codimension-one toric fiber product, and the quadratic moves of the 
form (6.1a) arise iteratively from the quadratic generators of Ik 2 r □ 

Now we proceed to describe the other minimal primes of the ideal Ig(K 2N _ 2 y 

Lemma 6.2. Let a,b G {3, . . . ,N}, and let C C [d a ] and D C [d b \. Then the ideal 
Pa,c,b,D generated by I s i(k 2 jv-2) an & the variables 

{Puk :K a eC}U {p 12K :K b eD}U {p 21K : K b <£ D} U {p 22K : K a £ C}. 
is a prime ideal containing I g \(K 2N _ 2 )- 

Proof. P a ,c,b,D is prime since it is a sum of geometrically prime ideals which are defined 
in disjoint sets of variables. This can be seen as follows: First, the variables in P a ,c,b,D 
generate a monomial prime ideal. Second, all binomial generators of I 2 are redundant 
modulo that ideal, i.e. they are implied by the variables in P a ,c,b,D- Third, let / = p u —p v 
be a binomial generator of I\. Then p u contains a variable generating P a ,c,b,D if and 
only if p v contains a variable in P a ,c,b,D- The binomials in 1% which are not implied by 
the variables in P a ,c,b,D correspond to rank conditions on disjoint slices of the tensor p; 
hence they generate a binomial prime ideal over any field. □ 

Proposition 6.3. All minimal primes of I g UK 2 jv-2) exce Pt the toric component I k 2 N _ 2 
are of the form P a ,c,b,D- Specifically: 

1. If N = A, then the set of minimal primes consists of the toric component and all 
primes of the form P a ,c,a,D, where a e {3, 4} ; 7^ C 7^ [d a ], and 7^ D 7^ [d a ]. 

2. If N > A, then the set of minimal primes consists of the toric component and 
all primes of the form P a cbD, where a,b G {3, . . . , N} , 7^ C 7^ [d a ], and 
0^D^[d b ]. 

The proof of Proposition 6.3 makes use of the following lemma. 

Lemma 6.4. For any K G n^st^L 

-^gi(^2,jv- 2 ) : PwkPtik = hKK 2 ,N~2) '■ P12KP21K = Ik 2 , N -2- 
In particular, if P is a minimal prime of I g \(K 2 N _ 2 ) o,nd not the toric component I K2 N _ 2 , 
then PHKP22K € P and p 12K p 21K G P. 
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Proof. We need to prove that both pnkLP22k L B^ 2 12L2lL22 and pi2kLP2ik L B^ 2L2lL22 
belong to I g i(K 2 N - 2 ) > an d by symmetry it suffices to treat the first binomial. Moreover, 
by symmetry we may assume a = 3. The calculation can be done using tableau 
notation: 



"1 


1 


fci 


Ln 


* 


1 


2 


k 2 


L\2 


+ 


2 


1 


k 2 


L21 




2 


2 


h 


L22 




1 


1 


k 


L 


* 


.2 


2 


k 


L . 


+ 



1 
1 

2 
2 
1 
.2 

k 
h 
h 
k 

k2 



1 

2 
1 
2 
1 

2 

L n 
L12 
L21 
L22 

L 

L 



k 
k 2 
k- 2 
k 

At 



L\2 

L21 
L22 

L 

L 



* 

1 
1 

2 
2 
1 
2 



1 1 



1 
2 
2 
1 
.2 

fc 

h 
k 

k- 2 



2 
1 
2 
2 
1 

L11 
L12 
L21 
L22 

L 

L 



k 
k 2 
k 2 
k 
At 
A-i 



Ln 

L\2 

L21 
L22 

L 

L 



+ 

* 
+ 



+ 
* 
+ 



1 


1 


A: 2 


Ln 


1 


2 


fcl 


L\2 


2 


1 


Ai 


L21 


2 


2 


A: 2 


L22 


1 


1 


k 


L 


2 


2 


k 


L 



Here, the first tableau and the last tableau correspond to the two monomials of 

PnkLP22kLB^ k \ll 2L2lL22 . □ 

Proof of Proposition 6.3. We use a set-theoretic argument. Let p be any point in the 
variety of I g \(K 2 N - 2 )i an d consider the (d 3 x • • • x G?Ar)-tensors A l i with = PijK- If 
no coordinate of p vanishes, then p is contained in the variety of Ik 2 , N -2- Therefore, 
suppose p^K = for some ijK e niLiM- ^he CI statements gl(iT 2] Ar-2) imply that 
all have rank one. Hence there must be an index a such that p^K' — whenever 
K' G riilst^] satisfies K' a = K a . In other words, for all i,j G {1,2}, the pattern of 
zeros within A^ is a union of (N — 3)-dimensional slices. 

For each a = 3, . . . , N let E l J be the largest subset of [d a ] such that p^x = 



1 j \ 



x ■ ■ 



x ([d N ]\E 



Al 



for 



whenever K a G E$ . Then ^ if and only if K G ([d 3 ] \ E : 
By Lemma 6.4, if p does not lie in the toric component, then pjj K 

all K G ([g? 3 ] \ E3) x ••• x ([djv] \ -E'tv) (remember that ij denotes the "opposite" 
string to ij, obtained by exchanging -H- 1 in each position). Again, each of these 
entries must be contained in an (N — 3)-slice of zeros. Hence there must be an index 
ctij such that [d aij ] \ E l J.. is a subset of E l J..; for otherwise, if for each a there exists 

% a G ([d a ] \E%)n ([d a ] \E%), then PijiPjjj ^ 0, where I a = i a for all a. This implies 
that we can find subsets C C [d ail ], D C [d ai2 ], such that p G V(P ailt c,a 12 ,D)- This 
shows the first statement, and it remains to see that certain choices of P a ,c,b,D do not 
appear. 

If C = 0, then P a ,c,b,D contains the toric component: Indeed, P a ,<D,b,D contains all 
monomials of the form P22K, and hence P a $bD contains all quartics. Therefore, P a ,$,b,D 
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is not a minimal prime, and the same is true if C — [d a ], D = or D = [df,]. Similarly, 
if N — 4, then P^^ad contains both monomials of any quartic. 

It follows that all minimal primes are among the ideals P a ,c,b,D listed in the statement 
of the theorem. It remains to show that all these ideals are indeed minimal primes. Note 
that each of these ideals contains a different set of variables of the same size, so they 
do not contain each other. Furthermore, they each leave out at least one of the quartic 
moves. Indeed, choose an index c G {3, . . . , N} \ {a, b}, choose k\, k 2 G [d c ], and choose 
L 1U L 12 , L 21 , L 22 G rii>3,^ c Mi] sucn that ( L n)a i C, (L 22 ) a G C, {L 12 ) b £ D, {L 2l ) b G 
D. Then P a ,c,b,D does not contain B^ k 12L2lL22 , and so 1k xn _ 2 £ P a ,c,b,D- □ 

Theorem 6.5. The global Markov ideal Ig\(K 2N ^ 2 ) ^ s a ™dical ideal when d\ = d 2 = 2, 
with irredundant prime decomposition 

Igi(K 2tN _ 2 ) = Ik 2 , n _ 2 n f]P a ,C,b,D 

with the intersection running over all a,b G {3, . . . , N}, C C [d a ], D C [d b ], C,D ^ 0. 
When N = A, we also require a = b. 

Proof. Let J be the intersection of the toric component with all minimal primes P a ,c,b,D- 
Lemma 6.2 shows JC j, and it remains to show the opposite inclusion. It suffices to 
consider binomials: By Proposition 6.3 the radical of / equals J, and therefore J is 
generated by binomials [13, Theorem 3.1]. 

Let p u — p v G J. If there exists a prime P a .c,b,D such that p u does not contain any 
of the variables defining P a ,c,b,D, then p u — p v actually belongs to the ideal generated 
by the binomial part of P a ,c,b,D, and hence p u — p v G /. Therefore, we may assume 
in the following that for any prime P a ,c,b,D the monomial p u contains at least one 
of the variables defining P a ,c,b,D- Since p u — p v G Ik 2 n _ 2 there is a decomposition 
pu _ pv _ Y^l^ip^' 1 — p Ui ), where u = u, u r = v, and — Ui is an element of the 
Markov basis. If uq— u\ is a quadratic element of the Markov basis, then p u — p" — p u -\-p Ul 
is an element of J and belongs to I if and only if p u — p v belongs to / (since p u — p Ul 
is contained in / as well as in each minimal prime). 

Assume that uq — u\ corresponds to a quartic move, say B^}^ 12L2lL22 for some 
ki,k 2 G [c] and Ln, Li 2 , L 2 i, L 22 G [d]. We use induction on the number of mismatches 
of Ln and L 22 and the number of mismatches of Li 2 and L 2 i to show that we can 
replace this quartic with a combination of quadratic Markov moves. This shows that 
p u — p Ul actually lies in J. If Lu = L 22 , then the calculation 

1 2 k x L X1 ] * 

1 2 k 2 Li 2 * 

2 1 k 2 L 21 + 
2 1 h L n + 



1 1 k x Lu 

1 2 k 2 L 12 

2 1 k 2 L 21 
2 2 h L u 
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1 2 k 2 L u 

1 2 ki L 12 

2 1 h L 21 
2 1 k 2 L u 



1 1 k 2 L u 

1 2 fcx L 12 

2 1 fci L 21 
2 2 &2 -^n 



shows that 2lLn is a combination of quadratic Markov moves and hence lies 

in J. By symmetry, the same is true when L 12 = L 21 . Therefore, we may assume 
Lu 7^ L 22 and L 12 7^ L 2 i m the following. 

As shown above, there exists a variable PijkL that divides p u and p Ul (in particular, 
Pijfci is not involved in B^^ h21 22 ). Without loss of generality assume i = j = 2. If 
there exists a > 2 such that L a = (Ln)„ 7^ (L 22 ) a , then we can apply the moves 



2 2 k\ L 22 
2 2k L 



2 2 k\ L 22 
2 2 k V 



, and 



2 2 k 2 L 22 
2 2 k L 



with (L' 22 ) b 



{L 22 ) b if byt a, 
L a if b = a, 



and Li 




2 2 ^22 
2 2 k V 

iib 7^ a, 
if 6 = a, 



to p u and p ui . This effectively replaces L22 by L' 22 , and Lu and L' 22 agree in more 
components than L n and L 22 . 

By symmetry, if there exist 2, j G {0, 1} and a > 2 with L = Lij) a 7^ (L^-) a , then 
we can apply quadratic moves to make L^- and L^- more similar to each other. Now 
we may assume that each variable PijkL that divides p u satisfies L a 7^ {Ljj) a . We show 
that it is still possible for some i,j to reduce the number of mismatches between L^ 
and Ltt. 

Choose indices a and b such that (Ln) a 7^ (L 22 ) a and (Li 2 )& 7^ (L 2 i)&. We claim that 
in this case, there exist k$,k± G [ds] and L 5 , L 6 G n^t^l sucn that 

• either (L 5 ) a = (L 6 ) a and p U k 3 L 5 P22k 4 L 6 divides p u , 

• or (L 5 ) 6 = (L 6 ) 6 and pi 2k3 L 6 P2ik 4 L 6 divides p u . 

Otherwise, p u would contain no defining variable of the prime P a ,c,b,D with 

C = {/ G [d a ] : pukL does not divide p" for all k G [di], L G JJjd s ] with L a = I}, 

s=2 

n 

D = {I G [c4] : pi 2 fcL does not divide p u for all k G [di], L G JJjd s ] with L b = 1} 



s=2 



(note that if N — 4, then a = b). By symmetry it suffices to consider the first case, 
i.e. (L 5 ) = (L 6 ) a and puk 3 L 5 P22k 4 L 6 divides p u . We can then apply the moves 



1 1 fci L n 
1 1 h L 5 



1 1 fci L' n 
1 1 fc 3 LC 



and 



2 2 
2 2 



fci 
A; 3 



L22 

^6 



2 2 
2 2 



ki L' 2 
fc 3 L' 
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with (!'„)„ i ! c ^°'(^ 

it c = a, 





,,,/ , i \-b;c lic^a, , y I (L 6 ) c lfc^a, 
and (L 22 ) c = ^ (L 6 ) c = ^ ; 

ifc = a, [(-^22ja irc = a, 

to p M and p ui . This effectively replaces L\\ by L' n and L 22 by L' 22 , and Z/ n and L 22 
agree in more components than L n and L 22 . This proves the induction step and shows 
that p u — p v lies in /. □ 

With this primary decomposition, we can analyze the positive margins property. 

Theorem 6.6. For N > 4, the complete bipartite graph K 2 ^_ 2 , where the first group 
of nodes is binary, has the positive margins property if and only if N = 4. 

Proof. We check the condition in Lemma 4.1. If iV = 4, then each minimal prime is of 
the form P = P a ,c,a,D- Because of the symmetry we may assume a = 3. Then 

'"/' = ] J Pllkl J J Pl2kl I f P2lkl ] [ P22H- 
k,l:k<£C k,l:k(£D k,l:keD k,l:k£C 

Suppose that C and D intersect. Then the {1, 3}-marginal of the exponent vector of 
nip is not strictly positive, since any variable pijki that divides nip satisfies k ^ C R D. 
Similarly, if C and D do not intersect, then C intersects the complement of D, and 
hence the {2, 3}-marginal cannot be strictly positive. 

If iV > 4, then consider a prime of the form P = P^,ca,d- Then 

m P = ] [ PuK ] [ P12K J"| P21K ] [ P22K, 
K:K a iC K:K b (£D K:K b eD K:K a &C 

and the exponent vector has strictly positive margins: Indeed, take for example the 
{1, a}-marginal. For any k G [d a ], choose K,L G [d 3 ] x ••• x [d N ] such that K b £ 
D,L b G D and K a = k = L a . Then P12KP21L divides m P , and hence the {l,fc}-count 
and the {2, fc}-count of the {1, a}-marginal are larger than zero. □ 

Finally, we want to prove that K 2y N-2 satisfies the interior point property. We first 
describe additional inequalities of the marginal cone. 

Lemma 6.7. Let N > 4, and assume d\ = d<i = 2. For any table u G N n , denote 
y = Au the vector of K 2t N-2-'m(irginals, which has components y l k \ for i = 1,2, j = 
3, . . . ,N, and (k, I) G [2] x [dj]. Let a, b such that 3 < a < b < N and let C C [d a ], 
D C [db] be non-empty subsets such that C 7^ [d a ] and D 7^ [df,]- For any choice of 
a,b,C,D 

(6-2) E + E & + E & - E vi * 0. 

keC k4C leD 1<=D 
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Proof. It suffices to show that each unit vector in N n satisfies (6.2). Consider the 
unit vector e x corresponding to x G X. If the last summand J2ieD Vu( e x) vanishes, 
then (6.2) holds. Otherwise, X\ — 1 and xi G D, and so this sum equals one. In this 
case, at least one of the following three possibilities happens: either x a G C, or x a C 

and x 2 = 2, or x 2 = 1. In any case, ^kecVik + HktcVll + HieoVu ^ x > and so ( 6 - 2 ) 
holds. □ 

Theorem 6.8. Assume that di = d 2 = 2. If u G N n /ias strictly positive K 2j n- 2 - 
margins and if u satisfies all inequalities of the form (6.2) with strict inequality, then 
the fiber of u is connected by quadratic moves. 

Proof. We apply Lemma 2.5. Let P = P a ,c,b,D be a minimal prime. If a = b, then 
the proof of Theorem 6.6 shows that the exponent vector up of irtp has at least one 
vanishing marginal. If a ^ b, then a direct verification shows that up satisfies 

E ^ + E ^ + E Vn - E Vn = °- D 

fceC k<£c leD leD 

Proof of Theorem 4-6. Combine Theorems 6.6 and 6.8. □ 
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